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Statistical  signal  processing  functions  such  as  signal  detection,  estimation,  and  identification  play 
a  key  role  in  the  development  of  effective  communications,  radar,  and  sonar  systems.  For  example, 
advanced  statistical  methods  are  emerging  as  being  particularly  important  in  digital  communications 
systems  operating  in  channels  corrupted  by  interference  from  such  phenomena  as  multiple-access  noise, 
intentional  jamming,  and  impulsive  noise  sources.  Conventional  demodulation  methods,  such  as 
coherent  matched  filtering,  often  suffer  serious  performance  degradation  when  subjected  to  interference 
of  these  types;  however,  this  degradation  can  frequently  be  eliminated  through  the  use  of  more  sophis¬ 
ticated  signal  processing  techniques. 

A  central  issue  in  the  design  of  effective  signal  processing  procedures  for  systems  operating  in 
channels  such  as  those  noted  above  is  that  of  channel  identification.  Although  certain  aspects  of  chan¬ 
nel  identification  have  been  studied  extensively,  one  area  in  which  there  is  a  pressing  need  for  further 
research  is  that  of  identification  of  impulsive  channels.  Communication  systems  are  seldom  interfered 
with  by  white  Gaussian  noise  alone,  yet  receiving  systems  in  general  use  are  those  which  are  optimum 
for  white  Gaussian  noise.  The  man-made  electromagnetic  environment,  and  much  of  the  natural  one, 
is  basically  "impulsive,"  i.e.,  it  has  a  highly  structured  fonri  characterized  by  significant  probabilities  of 
large  interference  levels.  In  addition  to  the  man-made  electromagnetic  environment,  there  are  many 
other  different,  common  and  widely-used  communications  and  remote-sensing  type  channels  where 
impulsive  noise  dominates,  e.g.,  extra-low-frequency  (ELF)  channels,  urban  radio  networks,  underwater 
acoustic  channels,  and  telephone  line  channels.  This  is  in  contrast  to  the  Gaussian  noise  processes 
inherent  in  transmitting  and  receiving  elements.  Since  the  conventional  receivers  are  effectively  linear, 
the  impulsive  character  of  the  interference  can  drastically  the  perfonnance  of  conventional  systems. 
Furthermore,  since  it  has  been  well-established  that  the  performance  of  communications,  radar,  and 
sonar  systems  can  be  greatly  enhanced  if  the  true  statistics  of  the  channel  are  known  and  exploited,  the 
problem  of  identification  of  impulsive  noise  chartnels  is  important  in  the  development  of  systems  that 
can  approach  the  performance  limits  set  by  such  channels. 

This  research  project  is  concerned  with  the  design  and  development  of  new  nonlinear  algorithms 
for  identification  of  nongaussian  noise  processes  and  for  reception  of  signals  corrupted  by  nongaussian 
noise.  In  particular,  the  overall  objectives  of  this  research  project  are:  (i)  the  development  of  suitable 
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channel  models  for  impulsive  interference;  (ii)  the  derivation  and  analysis  of  new  globally  optimum 
nonlinear  estimation  procedures  for  the  identification  of  impulsive  interference  channels,  and  (iii)  appli¬ 
cation  of  the  developed  algorithms  in  the  design  of  optimum  and  sub-optimum  adaptive  receivers  for 
the  detection  of  signals  in  non-Gaussian  noise  environments. 


RESEARCH  SUMMARY 


During  this  reporting  period,  the  focus  of  our  work  has  been  on  the  problem  of  obtaining 
optimum  and  efficient  identification  and  detection  procedures  for  impulsive  channels.  Of  particular 
interest  is  the  Middleton  Oass  A  noise  model,  which  is  a  widely-accepted  statistical-physical  model  for 
impulsive  interference  superimposed  on  a  Gaussian  background.  The  model  has  two  basic  parameters 
that  can  be  adjusted  to  fit  a  wide  variety  of  impulsive  noise  phenomena  occurring  in  practice. 

We  have  considered  the  problem  of  basic  batch  estimation  of  the  Qass  A  parameters  [15]-[17]. 
In  particular,  we  have  developed  a  consistent  and  asymptotically  efficient  estimator  of  the  Class  A 
parameters  that  is  practically  efficient  as  well.  The  development  of  this  estimator  began  with  an 
improved  method-of-moments  estimator  of  the  parameters  based  on  the  extraction  of  two  moments 
chosen  for  their  sensitivity  to  the  channel  parameters.  We  have  shown  that  this  moments  estimator  is 
relatively  simple  to  implement  and  yields  unique  estimates  of  the  parameters  that  converge  to  the  true 
parameters  at  ne  u-optimal  rates.  We  have  also  shown,  via  an  extensive  simulation  study,  that  the  esti¬ 
mator  yields  good  estimates  of  the  parameters  for  moderate  sample  sizes  but  that  a  significant  improve¬ 
ment  in  perfonnance  over  the  method-of-moments  estimator  is  possible  if  an  asymptotically  efficient 
estimator  can  be  found.  The  search  for  such  an  estimator  began  with  a  search  for  a  method  which 
identifies  the  consistent,  and  hence,  asymptotically  efficient  sequence  of  roots  to  the  likelihood  equa¬ 
tion.  One  method  that  has  the  potential  of  providing  such  an  estimator  is  maximum  likelihood.  We 
have  shown  in  this  study  that  the  maximum  likelihood  estimate  (MLE)  is  consistent  for  the  Gass  esti¬ 
mation  problem,  despite  the  existence  of  multiple  roots  in  the  asymptotic  likelihood  equation.  How¬ 
ever,  the  existence  of  these  multiple  roots  makes  the  MLE  very  difficult  to  implement  Fortunately,  the 
consistent  sequence  of  roots  can  be  located  using  an  alternative  method.  This  method  consists  of  ini¬ 
tiating  Newton’s  root-finding  method  on  the  likelihood  equation  with  the  method-of-moments  estimator 
and,  in  so  doing,  both  the  consistency  of  the  moments  estimator  and  the  efficiency  of  likelihood-based 
estimation  are  retained.  We  have  shown  that  this  Moment/Likelihood  procedure  does  indeed  yield  con¬ 
sistent  and  asymptotically  efficient  estimates  of  the  parameters.  Moreover,  via  an  extensive  simulation 
study,  it  was  seen  that  the  proposed  Moment/Likelihood  procedure  yields  excellent  estimates  of  the 
parameters  for  moderate  sample  sizes.  In  addition,  we  have  developed  an  optimization  scheme  based 
on  the  simplex  method  that  can  be  shown  to  converge  to  a  relative  maximum  of  the  likelihood  func¬ 
tion.  An  extensive  simulation  study  of  this  scheme  indicates  that  it  performs  very  well  for  small  sam¬ 
ple  sizes. 

The  problem  of  recursive  estimation  of  the  Gass  A  parameters  was  also  investigated.  Our  pri¬ 
mary  objective  in  this  phase  of  the  study  was  the  development  of  recursive  channel  estimators  that  are 
efficient  for  small  sample  sizes.  Only  in  this  way  can  we  guarantee  that  our  channel  estimator  is  capa¬ 
ble  of  tracking  rapidly-varying  nongaussian  channels.  In  particular,  we  have  developed  a  global  recur¬ 
sive  estimator  of  the  parameters  that  can  overeoine  the  shortcomings  of  conventional  recursive  stochas¬ 
tic  gradient-type  algorithms  which  make  them  unsuitable  for  impulsive  channel  identification.  The  pri¬ 
mary  shortcoming  is  that  the  conventional  algorithms  cannot  uniquely  identify  the  Gass  A  parameters 
due  to  the  existence  of  multiple  roots  in  the  asymptotic  likelihood  equation.  This  recursive  estimator  is 
based  on  the  use  of  a  nonstandard  stochastic  approximation  procedure  wherein  the  standard  Fisher’s 
information  matrix,  which  governs  the  step  size  in  the  recursion,  is  replaced  with  a  "complete-data" 
information  matrix.  Two  initiating  estimators  for  this  complete-data  stochastic  approximation 
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procedure  were  developed.  The  first  is  a  batch  estimator  which  extracts  estimates  of  the  parameters 
directly  from  a  histogram  of  the  Class  A  envelope  data.  The  second  is  a  method-of-moments  estimator 
applied  to  a  nontraditional  set  of  observations,  referred  to  as  "complete-data."  At  each  iteration  of  this 
initiating  recursive  estimator,  complete  data  are  generated  from  the  traditional,  or  incomplete,  observa¬ 
tions  using  the  estimate  of  the  parameters  obtained  at  the  previous  iteration.  A  fixed  parameter  vector 
in  the  parameter  space  initiates  the  process.  By  equating  sample  moments  of  the  complete  data  to  the 
true  moments,  estimates  of  the  parameters  are  then  obtained.  Both  initiating  estimators  were  found  to 
yield  estimates  which  lie  in  the  region  of  convergence  of  the  stochastic  approximation  procedure. 
Moreover,  via  an  extensive  simulation  study,  it  was  seen  that  the  proposed  stochastic-approximation- 
based  estimators  yielded  global  recursive  procedures  through  which  excellent  estimates  of  the  parame¬ 
ters  were  obtained  for  small  sample  sizes. 

During  this  period,  we  have  also  developed  efficient  detection  algorithms  for  a  wide  range  of 
impulsive  noise  models,  including  the  Class  A,  Johnson,  and  Laplacian  models.  The  design  of  these 
detection  schemes  was  based  on  the  use  of  nonparametric  density  estimates  in  the  optimum  detection 
strategy.  In  particular,  we  have  considered  nonparametric  density  estimates  based  on  the  kernel  estima¬ 
tor,  which  is  well-suited  for  the  heavy-tailed  distributions  considered  in  this  study.  Various 
modifications  to  the  basic  form  of  this  estimator  were  made  in  order  to  improve  its  performance  for 
small  samples  sizes.  These  modifications  include:  (i)  a  nonsymmetric  kernel  estimator  for  estimating 
envelope  densities;  and  (ii)  a  heuristically-motivaied  variable-kernel  estimator  based  on  a  generalization 
of  the  automatic  and  nearest-neighbor  kernel  estimates.  These  density  estimates  were  then  used  in  the 
design  of  efficient  adaptive  receivers  for  detection  of  signals  in  the  aforementioned  noise  environments. 
In  particular,  the  adaptive  receiver  for  the  small-signal  detection  problem  was  constructed  by  estimating 
the  optimum  small-signal  nonlinearity  using  the  nonparametric  density  estimates.  The  efficiency  of  the 
nonlinear  detectors  formed  with  the  kernel  estimator  were  then  compared  to  the  locally-optimum  detec¬ 
tor  based  on  the  actual  interference  density.  Via  an  extensive  small-sample-size  jjerformance  analysis, 
it  was  seen  that  the  proposed  detection  schemes  yielded  near-optimum  performance  for  the  wide  class 
of  impulsive  noise  densities  considered  in  this  study. 
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